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Abstract 



u 
q 

r~| , Several variations of the classical Kalman-Yakubovich-Popov Lemma, as well the 

"j^ I associated minimax theorem are presented. 

Notation and Terminology 

^ Z+ is the set Z_|_ = {0, 1, 2, ... } of all non-negative integers. jM = {s G C : Re(s) = 0}, 
^ C+ = {s e C : Re(s) > 0}, T = {z G C : \z\ = 1}, and D+ = G C : \z\ > 1} are the 
, frequently referenced subsets of the complex plane C: the imaginary axis, the open right 
CN " half plane, the unit circle, and the outside of the unit circle. C"'™" D M'^''" are the sets of 
OO n-hj-m matrices (complex and real), with the usual shortcuts = C^'^, R" = M"'^. For 
M G C'''", M' G C"''^ is the Hermitian conjugate (the result of applying both transposition 
and complex conjugation to M), while M G C'^'" is the complex conjugate of M. For a 
real vector space V, V'^ is the real vector space of all linear functionals / : ^ i— )■ M. 

5^ 1 The Classical KYP Lemma 



A number of alternative versions of the KYP Lemma, a classical result of the linear system 
theory, has been published over the last half century. The earlier formulations, such as 
[1], motivated by optimal linear feedback design applications, related positive definiteness 
(or semi-definiteness) of rational matrix-valued functions of a single complex variable on 
the real axis or on the unit circle (the so-called "frequency conditions") to the existence 
of "stabilizing" (or "marginally stabilizing") solutions of the associated Lur'e (algebraic 
Riccati) equations. Connections to dynamic programming and first order conditions of 
optimality allowed extensions to time-varying and distributed systems (see, for example, 
[2], [3]). Some of the more recent versions, such as [1], employ weaker assumptions to relate 
the frequency domain inequalities to feasibility of the semidefinite programs obtained by 
replacing the Lur'e or Riccati equations by the corresponding inequalities. 
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It appears that some useful versions of the KYP Lemma remain unpubhshed (or, at 
least, highly inaccessible). This paper aims to correct this by presenting several (as- 
sumedly) missing formulations. 



1.1 KYP Lemma in Discrete Time 



The classical KYP Lemma setup is defined by matrices A G C"'*^, B G C"'™, Q 
(^n+m,n+m. Coefficients of linear transformation 

(x, m) G C" X C"* ^ x+ = Ax + 5m G C", 
and Q is associated with the Hermitian form cr : C" x C™ i— )■ M: 



Q' G 



cr(x, u) 



X 
u 



Q 



X 

u 



(x G C", u G C"). 



1.1.1 Stabilizing Completion of Squares in Discrete Time 



This is one of the versions of the KYP Lemma, motivated by the linear quadratic optimal 
control design theory. 

Theorem 1.1 Assume that the pair {A^B), where A G C"'" and B G C""'*", is stabihz- 
able, in the sense that there exists a matrix K G C*"'" such that zin — A — BK is invertible 
for all z G C, \z\ > 1. Then for every matrix Q = Q' E C""'"™'"'"'"™ (and a defined in ( I J. J)) ) 
the following conditions are equivalent: 

(a) there exist matrices P = P' e C"'", C G C™'", D G C™'™ such that 

a{x, u) + x'Px - {Ax + Bu)'P{Ax + Bu) = \Cx + Du\'^ V x G C", uE 

\A~In XB 
C D 



det 



^0 V 



< 1; 



[1.2) 

:i.3) 



(b) the matrix 



niz) 



{zIn-A)-^B 



Q 



n A)-'B 



:i.4) 



defined for z ^ A(A) = {2; G C : det{zln — A) = 0}, is positive definite for all z eT 
except, possibly, a finite subset. 

Moreover, when matrices A,B,Q in (b) are real, the corresponding matrices P, C, D from 
(a) can be chosen to be real as well. 

A proof of Theorem 11.11 (as well as any other proof provided in this paper) can be 
found in the Appendix section. 

We will refer to Theorem 11.11 as the " stabilizing completion of squares" version of 
the KYP Lemma, because the right side of fll.2p can be viewed of a "complete square" 
quadratic form, and (11. 3p guarantees that the matrix A — BD^^C is well defined and 
"marginally stable" (has no eigenvalues z with \z\ > 1). 
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1.1.2 Application: Optimal Program Control 

The " stabilizing completion of squares" was originally motivated by an " abstract" optimal 
control question of finding the maximal lower bound of the functional 

oo 

Hx{-),u{-)) = 5^a(x(t),M(t)) ^ inf (1.5) 

t=o 

subject to linear equations 

x{t + 1) = Ax{t) + Bu{t), x(0) = a, (1.6) 
and the "finite energy" constraint 

oo 

j2Mt)\'+\u{m<oo, (1.7) 

t=0 

where A, B, Q, a are fixed, and x : H- C^, u : Z+ i— )■ C"^ are infinite dimensional 
decision variables. The following statement, which follows directly from Theorem II. H 
explains the relation between the optimization setup fll.5l) - fll.7p and Theorem 1 1.1[ 

Theorem 1.2 If the stabilizability assumption as well as conditions (a),(b) from Theo- 
rem li.il are satisfied tlien tlie infimum in l\1.5\) - lfT77\) equals —a' Pa, and tlie sum 

oo 

J2\Cx.it) + DuM' 

t=0 

converges to zero if and only if ^{xi{-),Ui{-)) converges to —a' Pa. 

1.1.3 Strict Linear Matrix Inequalities 

In many applications, the "stabilization" constraint is irrelevant, which motivates the 
following "strict linear matrix inequality (LMl)" version of the KYP Lemma. 

Theorem 1.3 For arbitrary matrices A G C"-", B G C"'*", Q = Q' e C"+'"''^+"* tlie 
following conditions are equivalent: 

(a) there exists P = P' & C"'" such that the Hermitian form ap : C" x C" i— ?■ M defined 
by 

ap{x, u) = cr(x, u) + x'Px - {Ax + Bu)'P{Ax + Bu) (1.8) 
is positive definite; 

(b) the Hermitian form a is positive definite on the subspace 

C{z) = {(x, m) G C" X C'" : zx = Ax + Bu} (1.9) 

for all z G T. 

Moreover, when matrices A,B,Q in (b) are real, the corresponding matrix P from (a) 
can be chosen to be real as well. 
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1.1.4 Non-Strict Linear Matrix Inequalities 

Since ap{x,u) = a{x,u) for G C{z), z eT, existence of a P = P' E C"'" for which 

the Hermitian form (11. 8p is positive semidefinite implies that a is positive semidefinite 
on C{z) for all z E T. In general, the inverse implication is not true: for example, when 
A = 0, B = 0, and a{x, u) = Re{x'u), the subspace C{z), for all z E T, consists of all pairs 
(0, u) with u E C, and, accordingly, a{x,u) = for {x,u) E C{z), z eT. However, there 
exists no P = P' G C^'^ (i.e. P G M) for which ap{x,u) = Re{x'u) + P|a;p is positive 
semidefinite. 

The following statement is a "non-strict LMI" version of the KYP Lemma which trades 
strict positivity for controllability of the pair {A, B). Recall that a pair {A, B) of matrices 
A E C"'", B E C"'™ is called controllable when the matrix [A/^ — A, B] is right invertible 
for all A G C. 

Theorem 1.4 Assume that the pair {A, B) of matrices A E C"'", B E C"'"* is control- 
lable. Then for every matrix Q = Q' E the following conditions are equivalent: 

(a) there exists P = P' E C"'" such that the Hermitian form ap : C" x C™" ^ M defined 
by i\1.8]] is positive semidefinite; 

(b) the Hermitian form a is positive semidefinite on the subspace C{z) defined by lll.9\] 
for all z eT. 

Moreover, when matrices A,B,Q in (b) are real, the corresponding matrix P from (a) 
can be chosen to be real as well. 



1.2 KYP Lemma in Continuous Time 

Continuous time (CT) versions of the KYP lemma are similar to their DT counterparts. 

Theorem 1.5 Assume that the pair {A,B), where A E C"'"" and B E C"'™', is stabiliz- 
able, in the sense that there exists a matrix K E C™''"' such that sin — A — BK is invertible 
for all s E C with Re(s) > 0. Then for every matrix Q = Q' E the following 

conditions are equivalent: 



(a) there exist matrices P = P' E C"'", C E C"'", D E C™'*" such that 
a{x, u) - 2Re[x' P{Ax + Bu)] = \Cx + Du\'^ 'i xeC^, uEi 



det 



A - sin B 
C D 



^0 V s G C 



:i.io) 
fi.ii) 



(b) the matrix n(s) defined by U.4\) is positive definite for all s E jM except, possibly, 
a finite subset. 
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Moreover, when matrices A,B,Q in (b) are real, the corresponding matrices P, C, D from 
(a) can be chosen to be real as well. 

Theorem 1.6 For arbitrary matrices A G C"'", B G C"'*", Q = Q' e C"+'"'"+'" the 
following conditions are equivalent: 

(a) there exists P = P' e C"'" such that the Hermitian form ap : C" x C" H- M defined 
by 

ap{x, u) = a{x, u) + 2Re[x' P{Ax + Bu)] (1.12) 

is positive definite; 

(b) the Hermitian form a is positive definite on the subspace C{s) for all s G jMU {oo}, 
where C{z) is defined by ( li.9)) for z G C, and 

C{oo) = {0} X C™. (1.13) 

Moreover, when matrices A,B,Q in (b) are real, the corresponding matrix P from (a) 
can be chosen to be real as well. 

Theorem 1.7 Assume that the pair {A,B) of matrices A G C"'", B G C"'™ is control- 
lable. Then for every matrix Q = Q' & ^n+m.n+m ^j^^ following conditions are equivalent: 

(a) there exists P = P' & C"'" such that the Hermitian form ap : C" x C™ i— )■ M defined 
by M.l'^ is positive semidefinite; 

(b) the Hermitian form a is positive semidefinite on the subspace C{s) defined by lll.9\] 
for all s G JR. 

Moreover, when matrices A,B,Q in (b) are real, the corresponding matrix P from (a) 
can be chosen to be real as well. 



2 A Minimax Theorem 

It is easy to show that the inequahty 

inf sup g{v,w) > sup inf g{u,w) (2-14) 

holds for arbitrary sets V, W and arbitrary real- valued function g : V" x t— )■ M. The term 
minimax theorem refers to a family of statements providing conditions (usually involving 
convexity of g with respect to v and concavity of g with respect to w) under which the 
inequality in fl2.14p is actually an equality, i.e. 

inf sup g{v, w) = sup inf g{v, w). (2-15) 

In this section, we are particularly interested in a specific minimax statement partially 
motivated by the KYP Lemma. 
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2.1 Minimax Theorems for Discrete Time LTI Systems 

For a positive integer m let £^ denote the standard real Hilbert space of all one-sided real 
m-vector valued square summable sequences, i.e. functions u : Z_|_ i— ?► such that 



< oo. 



(2.16) 



t=o 



Given a Schur matrix A G M"'*^ (i.e. such that z/„ — A is not singular for \z\ > 1), 
a vector a e M", and matrices 5i G M"''', ^2 G M"'^ Q G R^+^+^.'^+fc+g^ consider the 
functional g : il x i'^ R defined by 



g{v{-),w{-)) = (rix{t), v{t),w{t)) : x{t + 1) = Ax{t) + Biv{t) + 52w(t), x(0) = a, 

(2.17) 



where 







1 






X 




X 


(t(x, V, w) = 


V 


Q 


V 




w 




w 



(x G M", G M^ w G 



(2.18) 



Consider also the associated matrix 11 = 11(2;) defined by (11.41) with B = [Bi, B2], and 
its partition 



Il(z) 



Un{z) Uu{z) 



Un{z) G C^'^ n22(^) G C-'?. 



(2.19) 



Our objective is to formulate conditions, in terms of matrices Uij, which guarantee 
that equality fl2.15p is satisfied for all a G for the functional g : i^x i"^ M. defined by 
(12.171) . We are also interested in formulating conditions which ensure that the associated 
partial infimum and supremum 



g^{w) = mf g{v,w), g^{v) = sup g{v,w) 



(2.20) 



are finite, and that the resulting functions g^ : 
the standard Hilbert space metrics of i"^ and il, respectively. 



K, g^ : i-T- M are contmuous m 



2.1.1 A Counterexample 

The Parceval identity can be used to show that g{v,w) from (12.171) is convex with respect 
to V if and only if nii(-2) > for all 2 G T. Similarly, g{v,w) is concave with respect to 
w if and only if 1122 (-z) < for all 2; G T. However, these assumptions are far from being 
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sufficient to assure that the minimax identity fl2.15p is satisfied, as demonstrated by the 
example with 



A 



"00" 


, 51 = 


" 1 " 




" " 




" 1 " 








1 


, a = 






Q 



1 





-1 





-1 


1 


-1 


1 


1 





1 


-1 



i.e. when 

oo 

g{v{-),w{-)) = Y^Mt) - Mt)\' - 2v{t)[w{t) - x,{t)] - \wit) - x,im, 



t=0 



subject to xi(t + 1) = v(t), X2{t + 1) = xi(0) = 1, 0:2(0) = 0, 



and 



z' -I 



z - 1 

■\z-l\ 



Using the fact that the set of all possible sequences w — X2 'i^ dense in V = W = i"^, 
we conclude that 

00 

sup g{v,w) = ^{|t;(t) - xi(t)p + \v{t)\^} > \v{0) - Ip + \v{0)\^ > 0.5, 



t=0 



and hence the left side in (12.151) is not smaller than 0.5. 
On the other hand, using the fact that 

00 00 

^{a;i(t)x2(t) - v{t)w{t)} = ^{xi(t)a;2(t) ~ xi{t + l)x2{t + 1)} = Xi(0)x2(0) = 0, 

t=0 t=0 

one can re-write the sum for g as 

g{v{-),w{-)) = Y^Mt) - Mt)\' + 2[v{t) - x,it)]x2it) - \wit) - X2{m. 

Since the set of all possible sequences f — xi is dense in we conclude that 

00 

inf g{v,w) = V{-|x2(t)|' - \w{t) - X2(t)|'}, 



t=Q 



and hence the right side in f l2.15p is zero: the minimax equality does not hold in this case. 

It is instructive to note that, in this case, both functions gy and gy^ from fl2.20p are finite 
and continuous in the standard Hilbert space topology of but the minimax identity is 
still not valid. 
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2.1.2 A Sufficient Condition of Minimax 



The following statement shows that the minimax identity (I2.15p holds for the functional 
(12.171) when there exist e > and zq eT such that 



nn(^) eUuiz) 



>o v^eT, nn(2o)>o, n22(^o)<o. 



(2.21) 



Theorem 2.1 Let A G M"'"" be a Schur matrix. Assume that matrices Bi e M"'*^, 
B2 e M"'", Q e ]^n+k+g,n+k+g ^^^^ ^j^^^ condition where Uij are dehned by 

112. iy\] and ( 11.4)) with B = [Bi, B2], is satisGed for some e > and Zq e T. Then for every 
aeW for the functional g : il x £l ^ R defined by / I2T^) ./|2J8 |) 



(a) the partial optimal values in l\2.20\) are continuous in the standard norm topologies 
ofil and il; 

(b) the minimax identity in \2. 1 5)) is satisfied. 



2.1.3 Minimax and Integral Quadratic Constraints 

For a positive integer m let im denote the set of all functions u : Z_|_ i— )■ M™" (in particular, 
£^ is a subset oi irn)- In modeling discrete time dynamical systems, m-dimensional signals 
can be represented by the elements of im- Accordingly, a DT system A with A;- dimensional 
input V and g-dimensional output w is viewed as a subset A C £fc x £g. Let us call such 
system A C f a,, x ig weakly causally stable if for every T e Z+, (t>, w) G A, and f * G il such 
that v{t) = f*(t) for alH < T there exists a sequence of elements (fj, Wi) G A fl (£^ x ^g); 
such that Vi(t) = v{t) and Wi{t) = w(t) for all t <T, and — f*|| — )■ as i — > 00. 

Given real matrices A G M"'", 5i G M"''', ^2 e M"'^ Q G M"+fc+'?'"+fc+9, where A is 
a Schur matrix, and a subset Aq C M*^, let us say that system A G ik x iq satisfies the 
conditional Integral Quadratic Constraint (IQC) defined by A, Bi, B2, Q, Aq if there 
exists a continuous function k : M" x M'^ x M'^ t— )■ M such that 

00 

v{t),w{t)) > -k{xo, v{0), w{0)) (2.22) 

t=o 

for all {v,w) G An(£^ x £^), xq G Aq, where x(-) is defined by f (■), u'(-); and Xq according 
to 

x{t + l) = Ax{t) + Biv{t) + b2w{t), x{0) = xo. (2.23) 

Similarly, let us say that A C ik x £q satisfies the complete IQC defined by A, Bi, B2, Q, 
Xq if there exists a continuous function k: W xR'' xRi h^R such that 

T 

a{x{t),v{t), w{t)) > -k{xo, v{0), w{0)) (T > 0) (2.24) 

t=o 
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for all {v,w) G A, Xo G Xq, and x G satisfying fl2.23l) . 

An important step in the IQC framework of nonlinear system analysis is to establish 
that a particular conditional IQC fl2.22p implies the corresponding complete IQC fl2.24p . 
The implication is not always true: for example, when 

A = {{v,w) e i X i : w{t + l) =v{t)\/ t eZ+}, 

A = Bi = B2 = 0, Xo = {0}, (t{x, V, w) = \w\^ - \v\'^ 

then the conditional IQC fl2.22p is satisfied with k{xo,Vo,Wo) = |foP, but the associated 
complete IQC fl2.24p does not take place for any function k. 

The following statement, based on the minimax identity established in Theorem I2.H 
provides sufficient conditions, expressed in terms of matrices A, B, and Q, under which 
the conditional IQC from (12.220 implies the complete IQC from fl2.24p . 

Theorem 2.2 Let A G ikX iq be a weakly causally stable system which satisfies the con- 
ditional IQC dehned by real matrices A G M"-", Bi G W'^, B2 G M"'^ Q G M"+'=+9.'^+*^+9^ 
where A is a Schur matrix, and a subset Xq C M". Assume that 

(a) condition (\2.21]] . where Uij are defined by and ( fTT^) with B = [Bi,B2], is 
satisfied for some e > and Zq G T; 

(b) there exist real matrices C G M*^'", Di G M*^'^, D2 G M^''' such that the quadratic 
form a defined by / I2.J8)) satisfies the inequality 

a{x,v,w) <\Cx + Div + D2w\'^ M x eW , v eMl" , w eW , (2.25) 



and 

, ^ \A-I \Bi 
det 



C Di 

Then A satisfies the complete IQC defined by A,Bi, B2, Q, Xq. 



^ V A G C, |A| < 1. (2.26) 



2.2 Minimax Theorems for Continuous Time LTI Systems 

For a positive integer m let denote the standard real Hilbert space of all real m- vector 
valued square integrable functions u : [0, 00) 1— )► M"*, equipped with the norm 

POO 

\\u{-)f= / |n(t)pdt < 00. (2.27) 
Jo 

Given a Hurwitz matrix A G M"'" (i.e. such that sin — A is not singular for Re(s) > 0), 
a vector a G M", and matrices Bi G R"''', B2 G M"'^ Q G R"+'=+9-"+fc+9^ consider the 
functional g : x k-)- R defined by 

POD 

g{v{-),w{-)) = a{x{t),v{t),w{t))dt : x{t) = Ax{t) + Biv{t) + B2w{t), x{0) = a, 
Jo 

(2.28) 
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where a{-) is defined by fl2.18p . Consider also the associated matrix n(-) defined by fll.4p 
with B =[Bi, B2], and its partition f lTT^ . 

Our objective is to formulate conditions, in terms of matrices Uij, which guarantee 
that equality (12.151) is satisfied for all a G M*^ for the functional g : Ll x L'^ M. 
defined by (12.281) . We are also interested in formulating conditions which ensure that 
the associated partial infimum and supremum (l2.2Up are finite, and that the resulting 
functions : L"^ ^ 9w '■ ^1 M. are continuous in the standard Hilbert space 
metrics of and L^, respectively. 

2.2.1 A Sufficient Condition of Minimax 

The following statement shows that the minimax identity (I2.15P holds for the functional 
(I2.28P when there exist e > and sq G jM such that 



> y sejR, nn(so) > 0, n22(so) < O. (2.29) 



Theorem 2.3 Let A G M"'" be a Hurwitz matrix. Assume that matrices Bi E M"''^, 
B2 e Q e R"+fe+'?."+'=+9 are such that condition ^MB, wiere are dehned by 

\2. 1 9)) and ( II. 4)) with B = [Bi,B2], is satisfied for some e > and sq G j'M. Then for 
every a G for the functional g : Ll x ^ R defined by ^Zm . ^ZW(l 



(a) the partial optimal values in l\2.2U\) are continuous in the standard norm topologies 
of and Ll; 

(b ) the minimax identity in l\2. 1 5\) is satisfied. 



2.2.2 Minimax and Continuous Time IQC 

For a positive integer m let denote the set of all locally square integrable functions 
u : [0, cxd) I—)- (in particular, is a subset of Lm)- In modeling continuous time 
dynamical systems, m-dimensional signals can be represented by the elements of Lm- 
Accordingly, a CT system A with fc-dimensional input v and g-dimensional output w is 
viewed as a subset A C Lk x Lg. Let us call such system A <Z Lk x Lq weakly causally 
stable if for every T > 0, iv^w) G A, and G such that v{t) = f*(t) for all t < T 
there exists a sequence of elements {vi,Wi) G A fl {Ll x L^), such that Vi(t) = v(t) and 
Wi(t) = w{t) for all t <T, and \\vi — -> as i — > 00. 

Given real matrices A G M"-'', Bi G M"'^', B2 G W'", Q G where A is 

a Hurwitz matrix, and a subset Xq C M", let us say that system A C ^a,. x ig satisfies 
the conditional Integral Quadratic Constraint (IQC) defined by A, Bi, B2, Q, Xq if there 
exists a continuous function k: W xR^ xW h^R such that 

POO 

/ a{x{t),v{t),w{t))dt> ~k{xo,v{0),w{0)) (2.30) 
Jo 
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for all (f , w) G An (L^ x L^), xq G Xq, where x{-) is defined by f (■), w{-), and Xq according 
to 

x{t) = Ax{t) + Biv{t) + B2w{t), x(0) = xo, (2.31) 
which is understood, in a generalized sense, as 



xit) = Xo+ [Ax{t) + Biv{t) + 52w;(r)]rfr (t > 0). 
Jo 

Similarly, let us say that A C x Lg satisfies the complete IQC defined by A, Bi, B2, 
Q, Xq if there exists a continuous function k : M" x x M"^ 1— )■ M such that 

a{x{t),v{t),w{t))dt> -k{xo,v{0),w{0)) (T > 0) (2.32) 

for all {v,w) G A, xo G Xq, and x E Ln satisfying f l2.3ip . 

Theorem 2.4 Let A G LkxLq be a weakly causally stable system which satisfies the con- 
ditional IQC dehned by real matrices A G M"'", Bi G M"'^ B2 G M"'«, Q G ^"+^+"'"+^+5, 
wiiere A is a Hurwitz matrix, and a subset Xq C M". Assume that 

(a) condition l\2.29\) . where Uij are defined by ( 12. J 9)) and / fO]) witii i? = [^1,^2], is 
satisfied for some e > and sq G jM; 

(b) there exist real matrices C G M*^'", G M*^''"', D2 G M'''''^ sucii that the quadratic 
form a defined by h2.18^ satisfies the inequality i2.26\] . and 



det 



A -si Bi 
C Di 



7^0 Msec. 



(2.33) 



Then A satisfies the complete IQC defined by A,Bi, B2, Q, Xq. 



3 Appendix 

This section contains proofs of main statements made in the paper, including a brief 
description of some classical mathematical constructions used in the proofs. 



3.1 Quadratic Optimization and Minimax 

We begin by summarizing some elementary statements concerning quadratic functionals 
and real Hilbert spaces. 
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3.1.1 Quadratic Forms 

A function a : y i-> R defined on a real vector space V is called a quadratic form when 
a{v) — h{v, v) for all v & V, where b : V xV ^'M.is di, symmetric bilinear function, i.e. 

b{u,v) = b{v,u), b{u,xv + yw) = xb{u,v) + yb{u,w) \/ u,v,weV, x,yEM.. (3.34) 

This correspondence between symmetric bilinear functions and quadratic forms is a bi- 
jection, as b{-, •) can be recovered from a{-) according to the identity 



The quadratic form a is called positive definite (notation a ^ 0) when a{v) > for all 
V ^ 0, and positive semidefinite (notation cr > 0) when a{v) > for all v & V. Due to 
the identity 

ta{v) + (1 - t)a{u) - a{tv + (1 - t)u) = t{l - t)a{v - u) V -u e V, i G M, (3.35) 

which is valid for every quadratic form a : V ^ W, a is convex if and only if it is positive 

semidefinite. 

For example, a symmetric real matrix Q = Q' & M"'" defines a symmetric bilinear 
form bq : x M" i— )■ M according to bqiv^u) = v'Qu, and the associated quadratic 
form CTqiv) = 6q(v,v); the form ag (equivalently, the matrix Q — Q') is positive definite 
(or semidefinite) when all eigenvalues of Q are positive (notation Q > 0) or, respectively, 
non- negative (notation Q >Q). 

3.1.2 Quadratic Optimization and Real Hilbert Spaces 

In this paper, the terminology of quadratic forms is used to formulate statements (this 
makes assumptions easier to verify in applications), while the more fiexible Hilbert space 
viewpoint is employed in the corresponding proofs. The definitions and statements of this 
subsection facilitate easy switching between the two frameworks. 

Let b : V xV ^'M.hc a, symmetric bilinear form on a real vector space V such that 
the corresponding quadratic form (t{v) — b{v,v) is positive definite. Since the quadratic 
function 

t e M H-^ a{v + tu) = a{v) + 2tb{v, u) + t^a{u) 

takes only non-negative values, its discriminant is not positive, which yields the Cauchy- 
Schwartz inequality 



6(m, v) 



a{u + v) — a{u — v) 



4 




(3.36) 
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As a dual of a normed space (V, | ■ the pair {V^, \ ■ \„) defines a Banach space. Let 
TTg- : V he the "natural correspondence" mapping every v E V to f = tTo-v G V 

according to f{u) = b{v,u). 

The quantity |/|^, where / G can also be interpreted as the minimal upper bound 
in the quadratic optimization task 



Theorem 3.1 Let b : V x V t-^ W be a symmetric bilinear form on a real vector space 
V such that the corresponding quadratic form a{v) = b{v,v) is positive definite. Then 

(a) the set tc^jV is dense in {V^, \ ■ 

(b) there exists a (unique) symmetric bilinear form b : x i— )■ M such that |/|^ = 



(c) for the bilinear form b defined in (b), the identity f{v) = b{f,7c„v) holds for all 
f eV and V eV. 

Theorem 13.11 establishes (V", \ ■ \a) as a (real) Hilbert space, and provides a linear 
norm-preserving bijection tTo- between vectors from V and elements of a dense subspace 
Ti(^V of V^. It also shows that the minimal upper bound in quadratic optimization (I3.37p . 
as a function of / G V^^, is a quadratic form on the subset V" where its values are finite. 

In this paper, we will use either \w\ or \w\h to denote the norm of a vector w in 
a Hilbert space H. In addition, the shortcut v'u will denote the scalar product of two 
vectors v, u from the same Hilbert space H. This notation can be motivated by the 
natural association of vectors v & H with bounded linear functions : M i— )■ if defined 
by L^{t) = tv. Accordingly, the adjoint v' is the linear function v' : if i— t- M mapping 
u to the scalar product of v and u, and the composition v'u, where f,^ G if, is a linear 
function mapping M to M, i.e. a real number, which equals the scalar product of v and u 

3.1.3 Quadratic Minimax 

The following statement lists sufficient conditions for the minimax identity in quadratic 
optimization. 

Theorem 3.2 Let V, W be real vector spaces. Let g : V x W ^ M. be defined by 



2fv — a{v) I—)- sup. 



(3.37) 



because 




v) - a{v)} = inf mi{2f{tv) - a{tv)} = inf mi{2f{v)t - a{v)t'^}. 




b{f,f)forallfeV^; 



g{v, w) = cr(f ) + 2p{v, w) — fi{w) — 2f{v) + 2h{w) + r. 



(3.38) 
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where a : V ^ R, fi : W ^ R, p : V x W ^ R, f : V ^ R, h : W ^ R, and r e R 
are two positive definite quadratic forms, a bilinear functional, two linear functions, and 
a real number. Assume that 

(i) there exists c > such that c^a{v)jj,{w) > \p{v,w)\'^ for all v eV, w E W; 

(a) inf^^v 9(^,0) > —00 and sup^^^. g{0,w) < +00. 

Then 

(a) the minimax equality l{2.15\) holds; 

(b) there exists a constant Ci > such that 

ini g{v,w) > —Ci{l + fi{w)) Ww E W, sup g(v,w) < Ci{l + a (v)) \f v E V. 



Proof. By (i), for every v G V the function : 1— t- M defined by fv{w) = p{v,w) is linear 

and satisfies \fv\fj, < c\v\a, i.e. fv S W^. Since the corresponding function iTaV G 1— )• /t, S 

is hnear and bounded, it can be extended to a bounded hnear operator L : 1— )• such that 

p{v, w) = wLv (w = ir^w, V = vTo-w) y v £ V,w £ W. 

Since L is bounded, its adjoint L' is weh defined and bounded as weh. Also, by (ii), / G and 
h £ W^, hence the identity g{v,w) = g{v,w) holds for w = tt^w, v = tt^v, and 

g{v, w) = \v\'^ + 2w'Lv - \w\'^ - 2f'v + 2h'tlj + r. 



Let A : V"^ x 1— >• x be the linear operator with block representation 

A = 



I L' 
-L I 



i.e. A[v,w) = {v + L'w,w — Lv). Since A is bounded and A-\-A' = 2/ is strictly positive definite, 
A must be invertible, and hence there exist vq E V"', wq G such that A{vo,wo) = {f,h). 

Since L is bounded and the subsets tt^^V, vr^PF are dense in V"^ and respectively, we 
have (using notation v = iTaV, w = t^^{w) for u G 1/ and w £ W): 

svip g{v,w) = sup g{v,w) 

= sup g{v,w) 

= \v\'^ + \Lv + h\'^ - 2f'v + r 

= \v\'^ + \Lv — Lvq + Wop — 2{vq + L'wqYv + r 



\v - vol"^ + \L{v - vo)|^ + I'W^ol 



2wqLvo + r, 
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hence the second inequahty in (b) holds, and 



inf sup g{v,'w) = inf sup g{v,w) 

= Iwol"^ - Ivol"^ - 2wqLvo + r. 



Similarly, 



inf g{v,w) = inf g{v,w) 



inf g(v,w) 



2 



\L'w- f\'^ + 2h'w + r 



= —\w\'^ — \L'w — L'wq — t'oP + 2w'{wo — Lvq) + r 

= -\w - tDoP - \L'{w - wq)\^ + l^oP - bop - 2w'qLvo + r, 

hence the first inequality in (b) holds, and 

sup mi g{v,w) = sup inf g{v,w) = \wo\^ — \vq\^ — 2w'qLvo + r, 

which establishes the minimax identity. 

The bounds from (b) follow from the explicit expressions for the partial optimal values, and 
from the boundedness of L and L' . 



3.2 KYP Lemma Proofs 

This section contains proofs of the statements associated with the KYP Lemma. 

3.2.1 Theorem [EH (a)^(b) 

For z ^A{A) let 

L{z) = {zl - A)-^B, H{z) = D + CL{z). 
Substituting x = L{z)u (which means Ax + Bu = zx) with z & T into (11. 2p yields 

U{z) = H{z)'H{z) y ze T\A(A), (3.39) 

hence 11(2;) > for z G T\A(y4). Moreover, since 



det 



z-^A-I z-^B 
C D 



det H(z) 



for z 0, z ^ ^(^)) the rational function z t— )■ det H{z) is not identically equal to zero, 
and hence det H{z) ^ for all z G C except, possibly, a finite subset. Hence (I3.39P implies 
that 11(2;) is positive definite for all z G C except, possibly, a finite subset. 
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3.2.2 Theorem [EH (b)^(a) 



To prove the imphcation, we consider the associated optimization setup f ll.5p -f fr!7|) . which 
can be recognized clS 8b C3iSG of quadratic optimization. The key step is to show that the 
infimum in fll.5l) - fll.7p is finite. Then, according to Theorem 13. 11 inf $ is a quadratic form 
of a. We define P = P' hj inf $ = —a'Pa, and use the Bellman equation from dynamic 
programming to show that conditions fll.2p .f ir^ are satisfied. 

(a) Let be the set of complex square summable sequences w : Z+ h-)- C, equipped 
with the natural structure of a real vector space. Since A + BK is a Schur matrix, 
there is a linear one-to-one correspondence between the pairs {x,u) in f ll.6p . fll.7p 
and the pairs {w,a) E i"^ x C" which maps (x, u) to {u — Kx, a;(0)). 

Using the Parceval identity, the functional $ in (II. 5p can be re-written in the form 



{w{zya{z)w{z) + 2Re[w{z)(3{z)a] + a''y{z)a}dm{z) 



(3.40) 



where 



f{z)dm{z) = ^ I f{e^')de 
denotes the standard Lebesque measure integral on the unit circle T, 



wiz) 



t=0 



is the Fourier transform of if G a square integrable function w : T i— )■ C, and 
a,/9,7 are the rational matrix-valued functions defined by the block decomposition 
identity (to be satisfied for z eT) 



a{z) f3{zy 
m 7(^) 



M{zyQM{z) 



with 



M{z) 



I 
K I 



[zI - A- BK)-^ 
/ 



B I 
I 



Since A + BK is a Schur matrix, a,/3,7 have no poles on the unit circle T. Also, 
since 

a{z) = F{zyU{z)F{z), where F{z) = [I - K{z - A)-'^B]-'^ 

for z eT, the matrix a{z) is positive definite for all 2; G T except, possibly, a finite 
subset, where it is positive semidefinite. 

Since, at the points where a{z) is positive definite. 



w'a{z)w + 2Rew' (3{z)a > — a'/3(z)'a;(z) '^(3(z)a V w G C, 



16 



the conclusion inf $ > — oo can be reached easily when there exists a constant c G M 
such that I3{zya{z)-'^l3{z) < c/„ for all z G T with a{z) > 0. While such c G M 
does not always exist, we can use the fact that 

/ w{zy6{z)dm{z) = 

for every w G £^ and every strictly proper rational matrix 6 = 5{z) with no poles 
outside the open unit disk \z\ < 1. 

Indeed, to prove that inf $ > — oo, it is sufficient to find a strictly proper rational 
matrix function 6 = 6{z) with no poles outside the open unit circle 1^1 < 1, with 
the property that there exists a constant c G M such that 

{/3{z) - 6{z)ya{z)-\/3{z) - 6{z)) < dm for z G T : a{z) > 0. (3.41) 

Let 

R = maxAmax(a(^)) 

be the maximal eigenvalue of a{z) over 2; G T (it exists since a is continuous on T). 
Then a{z) > p{z)Ifn for all 2; G T, where the scalar rational function p = p{z) is 
defined by 

piz) = det(a(2))i?^-'^. 

Hence condition fl3.4ip will be satisfied, for some c G M, when the ratio {P — 6)/p 
is bounded on T, i.e. when the unit circle zeroes of the scalar components of /3 — 5 
match (counting multiplicity) the unit circle zeroes of p. 

Recall that for every set of distinct complex numbers {Xi)'^i and polynomials 

rrii-l 
1=0 

there exists a polynomial p = p{X) of degree ^ rrii such that 

p(A)-p,(A)=O((A-A,)'"0 as A^A, V z. 

Hence the boundedness of {(3 — 6)/p onT can be achieved by selecting S = S{z) as 
a linear combination of a sufficiently large number of monomials z~^ with positive 
integer i, which completes the proof of the inequality inf $ > — 00. 

(b) Since V{a) =^ inf $ > —00 for every a G C", Theorem 13. H together with represen- 
tation (13.401) . imply that V = V{a) is a quadratic form of a G C". Moreover, since 
multiplying a solution {x,u) of (11.61) with a;(0) = a by j yields a solution {jx,ju) 
of (II. 6p with a;(0) = ja and the same value of $, we have V{ja) = V{a) for every 
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a G C", which imphes that V{a) = —a' Pa for some fixed complex n-hj-n matrix 
P = P'. The Bellman inequality for the optimization task (ll.5p - (ll.7l) can be written 
in the form 

(3.42) 



inf {a{x, u) + V{Ax + Bu) - V{x)} = 0. 



Since /i(x, u) =^ a{x, u) + V{Ax + Bu) — V{x) is a quadratic form in (x, u), condition 
flXi2]) means that fx{x,u) = \Cx + Du\^ for some C E C™'" and D E C"'™ such 
that D is not singular. In other words, representation (11. 2p takes place, and the 
inequality in (II. 3p is satisfied for A = 0. 

To show that the inequality in (11.30 is satisfied for < |A| < 1, note that otherwise 
there exist p E C"', q E C™, and ^ E C such that 



p 


1 - 







^A~I iB 
C D 



= 0, 


p 







7^0, |e|G(0,l). 



Then g 7^ (otherwise ^p' A = p, p'B = 0, p 7^ and hence the pair [A, B) is not 
stabilizable), and therefore it is possible to re-scale {p, q) in such a way that |g| = 1. 
Hence, for a solution x, u of (II. 5p 

\Cx{t) + Du{t)\^ > \q'Cx{t) + q'Du{t)\^ 

= \p'x{t) - ^pAx{t) - ip'Bu{t)\'^ 

= \p'x{t)-ip'x{t + l)\\ 

which implies that 



Y,\Cx{t) + Du{t)\''>{l-m\p'a 



/„|2 



(3.43) 



contradicting the construdtion of C,D, which guarantees that the maximal lower 
bound of the left side in (13.431) is zero for all a G C". 



3.2.3 Theorem [EH the Case of Real Coefficients 

When the matrices A,B,Q in (b) are real, for every solution {x, u) of (11.60 with a;(0) = a 
the conjugated pair (x,u) is a solution of (I1.6P with x(0) = a and the same value of $. 
Hence V{a) = V{a) for every a E C", which implies that the (generally complex) matrix 
P = P' in the representation V{a) = —a' Pa actually has real coefficients. Since, in this 
case, the Hermitian form a(a;, u) — V{x) + V{Ax + Bu) has real coefficients, the matrices 
C, D can also be chosen to be real. 
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3.2.4 Proof of Theorem D 



By (11.21) we have 

oo 

$ = -a' Pa + ^ \Cx{t) + Du{t)\'^, 
t=o 

and it was aheady shown in the proof of Theorem 1 1 . 1 ^ (b ) ^ (a) that inf $ = —a' Pa. Hence 
$ converges to its maximal lower bound if and only if the sum of squares of Cx + Du 
converges to zero. 

3.2.5 Proof of Theorem [TTSl 

The implication (a)^(b) is trivial, as substituting a non-zero pair {x,u) from C{z) with 
\z\ = 1 into (11. 8p yields a{x,u) = ap{x,u) > 0. 

To prove that (b) implies (a), assume that (b) is true but (a) is not, which means that 
is not in the convex set 

n = {Q + E'^PEq - E[PEi -S : S = S' > 0, P = P'}, 

where 

Eo = [In 0], Ei = [A B]. 

According to the Hahn-Banach theorem there exists a hyperplane which separates (non- 
strictly) Q from zero, i.e. there exists matrix H = H' ^ such that 

tT{XH) < y X en. (3.44) 

Using (KM^ with X = Q - tl where t yields ti{QH) < 0. Using (^ZS) with 
X = Q — I — tpp' where t — )■ +oo yields ii{Hpp') > for every p G C""'"''", i.e. H > 0. 
Similarly, using (ICTl) with X = Q - I + t^E'^PE^ - E[PEi) where t ±oo yields 
ti{H{E'QPEo - E[PEi)) = for every P = P', i.e. EqHE'q = EiHE[. The last equality 
implies existence of a unitary matrix U such that UH^^'^Eq = H^^'^E[, or, equivalently, 
EqH^/'^U' = EiH^/'^. Let Wi, . . . ,Wn+m be an orthonormal basis of eigenvectors of U', 
with Zi eT being the corresponding eigenvalues. Define G C", G C™ by 

= H'/'w,. 

By construction, (xj, Ui) G C{zi), and hence by assumption (b) e-Qcj > whenever ^ 0. 
On the other hand 

n+m n+m 

> tT{QH) = tr(Q = Yl 

i=l i=l 

which means e'^Qci = for all i. Hence Cj = for all i and therefore H = 0, which 
contradicts the construction. 
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To complete the proof, consider the case when A, B, Q have real coefficients. Then for 
every P = P' such that up > we also have ap > 0, and hence, for P = 0.5(P + P), 

ap = 0.5((Tp + ap) > 0. 



3.2.6 Proof of Theorem [TTl 

The implication (a)^(b) follows in the standard was by substituting an arbitrary pair 
from C{z) with \z\ = 1 into (11. 8p . which yields a{x,u) = ap{x,u) > 0. 

To prove that (b) implies (a), consider the optimization task fll.5l) - fll.7p . take any K 
such that A + BK is a Schur matrix, and consider the Fourier transform repesentation of 
$ given by (I3.40p . Since a{z) > for all z G T, we have inf $ > — oo for a = 0. Therefore 
inf $ > — oo for every a G C" which is reachable from x(0) = in system (11.51) . Since the 
pair {A, B) is controllable, we conclude that inf $ > — oo for every a G C". 

We now use the same arguments as in the proof of Theorem 11.11 to establish that 
inf $ = —a' Pa for some matrix P = P' (real whenever A, B, Q are real). Finally, positive 
semidefiniteness of ap follows from the Bellman equation. 



3.2.7 KYP Proofs in Continuous Time 

In principle it is possible to translate all steps in the proofs of Theorems ll.mi.4l into a 
continuous-time format. However, there is a simple way of deriving the CT versions from 
the DT ones. 

Choose r > in such a way that the matrix rl — A is not singular. Let C = CU{oo}). 
Consider the bijection ho : C C and the linear bijection hi : C" x C"* i— > C" x 
which map s E C to z = ho{s) G C and (x, m) G C" x C" to (x, u) = hi{x, u) E C x 
according to 

A D f OO, s = r 

rx — Ax — Bu I 

X = ^ , z = i —1, s = oo, 

, otherw 

r~s ' 



' '^^^ otherwise. 



Define A, B, a by 

A = {rl + A){rl - A)-\ B = V^{rl - A)-^B, 

and 

a{x,u) = a{x,u) for {x,u) = hi{x,u) 

(note that A, B, a will have real coefficients whenever A, B, a have real coefficients). 
Simple algebraic manipulations can be used to show that 

(a) for (x, u) = hi{x, u), equality sx = Ax + Bu is satisfied if and only if zx = Ax + Bu 
(including the case s = oo,2; = — 1, in which = Ax + Bu is interpreted as 

X = 0, as well as the case z = oo, s = r, in which = Ax + Bu is interpreted 

as X = 0); 
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(b) for every {x,u) = hi{x,u), the identity 

2x'P{Ax + Bu) = (ix + BuyP{Ai: + Bu) - x'Px 

holds; 

(c) /io(jMU{cx)}) = T; 

(d) s is an eigenvalue of A if and only ii z = ho{s) is an eigenvalue of A. 

In order to prove the CT statements for some A, B, a, choose r and construct A, B, a 
first. For z E T\A{A) define Il = Il{z) by the identity 

ull{z)u = d-{x, u), subject to zx = Ax + Bu. 

Then n(s) = 11(2;) for z = /io(s), i.e. the positive definiteness/semidefiniteness of n(^) on 
T is determined by positive definitess/semidefiniteness of n(s) for s G M U {c>o}. When 
matrices C, D are given, define (7, D by the identity 

Cx + Du = Cx + Du for {x,u) = hi{x,u). 

Now the DT statements of the KYP Lemma applied to A, B, a, U (and, possibly, C, D, 
P = P) prove the corresponding CT statements of the KYP Lemma. 

3.3 Minimax Theorem Proofs 

This section contains the proofs of the minimax theorems associated with the KYP setup, 
as well as the corresponding IQC statements. 

3.3.1 Proof of Theorems [Hi] and [273] 

The proof is based on associating the statements with the more general setup of Theo- 
rem [3l2l 

In the DT case, let V = £l, W = f^. The functional g defined by (ICTj) . (I2A8|) is a 
quadratic form of (f , w, a) G V ^ M". Hence for every fixed a G M" it defines it defines 
unique quadratic forms a, /i, bilinear form linear functions /, h, and a constant r such 
that representation fl3.38p takes place. According to Theorem II. condition nii(z) > 
(for z E T), coupled with nii(2;o) > (both parts of assumption fl2.2ip ). implies that 
giy, 0) has a finite lower bound. Similarly, 1122(2;) < (for z G T), coupled with nii(2;o) < 
0, implies that 5^(0, w) has a finite upper bound, so condition (ii) of Theorem 13.21 is 
satisfied. Finally, in terms of Fourier transforms we have 

a{v) = I v'I{iivdm{z)., fi{w) = / wll22wdm{z), p{v,w) = Re / v'lli2wdm{z). 
Jt Jj Jt 
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Since (12.21 1) implies that the matrix 



e fjw'll2ivdm{z) — f^w'Il22wdm{z) 

is positive semidefinite for all v E il, w E i^, condition (i) is satisfied with c = 

According to Theorem 13.21 this means that the minimax equahty holds. The bounds in 
(b) are now established as well. Since the partial optimal values are quadratic functionals, 
the bounds establish their continuity. 

The proofs for the CT case follow the same pattern, with CT Fourier transform re- 
placing the DT version. 
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3.3.2 Proof of Theorems [212] and D 

Consider the DT case first. For every (t>o, wq) E A, xq E Xq, and T > consider functional 
g from Theorem 12. II defined with a = x{T + 1). According to (b), for every fixed w E ig 
the maximal lower bound of g{v,w) with respect v E il is not positive, i.e. 

sup inf g{v, w) < 0. 

w ^ 

By Theorem 12. 

inf sup g{v, w) = sup inf g{v, w) < 0, 

which means that there exists a sequence of signals {vi}'^i C il such that g{vi,w) <l/i 
for all 2 G {1, 2, ... } and all w E ig. In addition. Theorem 12. II also claims that sup^ g{v, w) 
is a continuous in the metric of the Hilbert space defined by the associated quadratic form 
a. Since, for v E il, 

a{v) = / v{z)'Ilu{z)v{z)dm{z), 



and IIii is uniformly bounded on T, the norm a{vY^'^ is majorated by the standard Hilbert 
space norm of £l, and hence sup^ g{v,w) is a continuous in the standard metric of il- 
Accordingly, there exist a sequence of signals {vi}°Zi <^ ^1 ^ sequence of positive 
numbers Si > such that g{u,w) < 1/i for all i E {1,2, . . .}, u E il, and w E ig such 
that |m — -Ujl < 6i. 

For every i E {1,2, . . .} let 



v{t), t < T, 

Vi{t-T-1), t>T. 



Since A is assumed to be weakly causally stable, there exist {v,w) E A n {£l x i^) such 
that v(t) = v(t), w(t) = w{t) for t < T, and |{; — < 6i. Due to the way in which Vi, 6i 
were chosen, for the corresponding solution x of 

x{t + 1) = Ax{t) + Biv{t) + B2w{t), x{0) = xo 
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we have 

y2a{x{t),v{t),w{t)) < -. 

t>T 

Since 

oo 

^a{x{t),v{t),w{t)) > k{xo,v{0),w{0)) 

t=0 

by the conditional IQC assumption, and x = x, v = v,w = w for t < T for aU i, we 
conclude (by letting i — )■ oo) that 



t=Q 



which proves the complete IQC. 

The derivation in the CT time case follows the same steps, with the definitions of a 
and V* being modified to a = x{T) and 



v{t), t<T, 
Vi{t-T), t>T. 
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